Signal processing apparatus and image data generation apparatus with electronic reduction and enlargement signal processing capabilities

ABSTRACT

A recording mode control circuit controls a first recording mode in which still image data having a first image size corresponding to the number of pixels of an image sensing element is generated and recorded and a second recording mode in which moving image data having a second image size smaller than the first image size is generated and recorded. In generating the moving image data in the second recording mode, a camera signal processing circuit executes electrical zoom processing to obtain the second image size. At this time, a maximum magnification ratio setting circuit sets the maximum variable magnification ratio of electrical zoom processing in the camera signal processing circuit. With this processing, an image recording apparatus which allows a user to select a zoom mode with a small degradation in image quality in electrical zoom processing can be implemented.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of application Ser. No. 10/790,930,filed Mar. 1, 2004 now U.S. Pat. No. 7,602,425 the entire disclosure ofwhich is hereby incorporated by reference.

FIELD OF THE INVENTION

The present invention relates to a signal processing apparatus and animage data generation apparatus that have both optical and electricalzoom means.

BACKGROUND OF THE INVENTION

In recent years, image recording apparatuses (or signal processingapparatuses or image data generation apparatuses) such as digital videocameras and digital (still) cameras are widely used in the ordinaryhousehold. Such image recording apparatuses generally have a zoomfunction capable of continuously changing the photographing view anglefrom a wide-angle mode to a telephoto mode by user operation. Many imagerecording apparatuses have even an electrical zoom function ofelectronically variably magnifying photographing image data in additionto a conventional optical zoom function using a zoom lens opticalsystem.

FIG. 26 is a block diagram showing the schematic arrangement of aconventional image recording apparatus having an optical zoom functionand an electrical zoom function. Referring to FIG. 26, a lens opticalsystem 2301 includes an optical lens which forms an image of incidentlight on an image sensing element 2302, an aperture, a focus controller,various kinds of optical filters, and a driving mechanism for them. Thelens optical system 2301 can execute optical zoom for optically changingthe view angle and includes a driving mechanism for it.

The above-described optical mechanism in the lens optical system 2301 ofthe image recording apparatus shown in FIG. 26 is a common mechanism,and a description thereof will be omitted. The image sensing element2302 converts the optical signal of an image formed on thelight-receiving surface by the lens optical system 2301 into anelectrical signal. For example, a CCD (Charge Coupled Device) and a CMOS(Complementary Metal Oxide Semiconductor) sensor are known.

An A/D (Analog-to-Digital conversion) circuit 2303 converts the imagesensing signal, which has been converted into an electrical signal bythe image sensing element 2302, into digital image sensing data (to bereferred to as image sensing data hereinafter). A memory 1 (2304) storesthe image sensing data converted by the A/D circuit 2303. At this pointof time, the image sensing data is digital data in an output formatunique to the image sensing element (the output format changes dependingon the pixel array and the color filter array). A camera signalprocessing circuit 2305 executes various processing operations forconverting the image sensing data supplied from the memory 1 (2304) intoimage data. A zoom control circuit 2307 controls an optical zoom controlcircuit 2306 in accordance with input from a zoom operation key 2310.The zoom control circuit 2307 also controls an enlargement processingcircuit 2309 through a switch 2308. The optical zoom control circuit2306 controls the lens optical system 2301 to perform optical zoom underthe control of the zoom control circuit 2307. The enlargement processingcircuit 2309 executes electrical zoom processing under the control ofthe zoom control circuit 2307. That is, the zoom control circuit 2307allows optical zoom or electrical zoom processing.

An electrical zoom ON/OFF switch 2311 turns on/off the electrical zoomfunction. When the electrical zoom ON/OFF switch 2311 is OFF, the switch2308 is turned off to inhibit the enlargement processing circuit 2309from executing enlargement processing. When the electrical zoom ON/OFFswitch 2311 is ON, the switch 2308 is turned on to cause the enlargementprocessing circuit 2309 to execute enlargement processing. Theelectrical zoom ON/OFF switch 2311 is prepared for users who dislike adegradation in image quality due to enlargement by electrical zoom sothat photographing can be executed while setting the zoom control modefor only optical zoom.

A memory 2 (2312) stores image data which has undergone camera signalprocessing and enlargement processing. A recording signal processingcircuit 2313 executes compression-coding, recording format generation,error-correcting coding, or recording modulation coding for the imagedata read out from the memory 2 (2312). A recording medium 2314 recordsthe image data processed by the recording signal processing circuit2313.

The optical zoom and electrical zoom operations in the image recordingapparatus shown in FIG. 26 will be described next.

FIG. 27 is a view showing the optical zoom and electrical zoomoperations in the image recording apparatus shown in FIG. 26. A frame2401 indicates the range of the object (including a tree, a skier, and acloud) of image data stored in the memory 1 (the frame 2401 indicatesthe view angle). The frame 2401 becomes large as the optical zoom shiftsto the wide-angle side. More specifically, in a zoom control region 2406for optical zoom, when the lens optical system 2301 is controlled to themaximum wide-angle state, the frame 2401 becomes large. At that viewangle, a wide-angle image 2403 is obtained. Accordingly, the image dataof the object indicated by the wide-angle image 2403 is stored in thememory 1. In the zoom control region 2406, when the lens optical system2301 is controlled to the maximum telephoto state, a telephoto image2404 is obtained at the view angle corresponding to the frame 2401.Accordingly, the image data of the object indicated by the telephotoimage 2404 is stored in the memory 1. As described above, the imagerecording apparatus shown in FIG. 26 executes the zoom operation bychanging the photographing view angle (the range of the frame 2401) bycontrolling the lens optical system 2301.

On the other hand, in a zoom control region 2407 for electrical zoom, apartial area indicated by a frame 2402 is extracted and enlarged fromthe image data of the object within the frame 2401 in the maximumtelephoto state, thereby obtaining an electrical zoom image 2405.

At this time, the image quality degrades to some extent in electricalzoom processing, as described above. Especially, when the magnificationratio of electrical zoom is high, the image quality largely degrades. Toprevent this, the magnification ratio of electrical zoom is generallylimited by defining an upper limit value.

There is also disclosed an information recording apparatus (imagerecording apparatus) capable of preventing any unintentional degradationin image quality by excessive electrical zoom processing (e.g., JapanesePatent Laid-Open No. 2001-197347). In this apparatus, when electricalzoom processing may cause an undesirable degradation in image quality,the electrical zoom processing is restricted, or a warning is displayed.

More specifically, the information recording apparatus comprises animage sensing unit which senses an image, and an electrical zoomprocessing unit which acquires a selected image within a predeterminedrange from the image obtained by the image sensing unit and converts theselected image into an output image having a predetermined number ofpixels. The electrical zoom processing unit has a selection rangecondition setting function of setting a condition to be satisfied by theselected image by referring to the number of pixels of the output image.The apparatus further comprises a notification unit which notifies auser that the condition is not satisfied when the selected image doesnot satisfy the condition. With the above-described arrangement, whenelectrical zoom processing may cause an undesirable degradation in imagequality, the electrical zoom processing can be restricted, or a warningcan be displayed.

Some signal processing apparatuses and image data generationapparatuses, which have come along in recent years, record reduced imagedata smaller than the image size of the image sensing element in somerecording modes, as in the moving image photographing mode of a digitalvideo camera having a still image photographing function. In such signalprocessing apparatuses and image data generation apparatuses, even whenphotographing is performed by setting for only optical zoom, the imagedata is further reduced electronically and recorded in some recordingmodes. That is, setting for electrical zoom is not done in considerationof the electronic reduction. In other words, it is inconsistent with theprimary purpose of the photographing mode which prevents, by electricalzoom ON/OFF setting, the degradation in image quality by enlargementprocessing.

SUMMARY OF THE INVENTION

The present invention has been made in consideration of theabove-described problem, and has as its main object to provide a signalprocessing apparatus and an image data generation apparatus, which allowa user to select a zoom mode with a small degradation in image qualityin electrical zoom processing.

According to an aspect of the present invention, signal processingapparatus which changes a magnification ratio of an image acquired byimage sensing means, characterized by comprising: first signalprocessing means for executing first signal processing for reducing animage sensing signal with respect to a scanning range of an obtainedimage sensing surface when the magnification ratio of the image is to beincreased; second signal processing means for executing second signalprocessing different from the first signal processing to change themagnification ratio of the image; first detection means for detectingselection of one of a telephoto side and a wide-angle side; seconddetection means for detecting a limit of an increase in magnificationratio of the image by the first signal processing; and selection meansfor selecting one of a first mode and a second mode; wherein when thefirst mode is selected by the selection means, and the first detectionmeans detects that the telephoto side is continuously selected, thefirst signal processing is executed, and when the second detection meansdetects that the increase in magnification ratio of the image by thefirst signal processing has reached the limit, the second signalprocessing is subsequently executed to enlarge the image, and when thesecond mode is selected by the selection means, even when the seconddetection means detects that the increase in magnification ratio of theimage by the first signal processing has reached the limit, and thefirst detection means then detects that the telephoto side iscontinuously selected, the second signal processing is inhibited.

According to another aspect of the present invention, an image recordingapparatus characterized by comprising a signal processing apparatus ofthe present invention; and optical variable magnification means forchanging a view angle of an object image formed on a light-receivingsurface of image sensing means, wherein variable magnification by theoptical variable magnification means is executed in first signalprocessing.

According to further aspect of the present invention, an image datageneration apparatus which generates image data on the basis of imagesensing data photographed by an image sensing element, characterized bycomprising: recording mode control means for controlling a firstrecording mode in which image data in a first image format having afirst image size corresponding to the number of pixels of the imagesensing element is generated and recorded, and a second recording modein which image data in a second image format having a second image sizesmaller than the first image size is generated and recorded; electronicvariable magnification means for executing electronic variablemagnification processing in generating the image data in the secondimage format in the second recording mode; maximum variablemagnification ratio setting means for setting a maximum variablemagnification ratio in the electronic variable magnification means; andvariable magnification ratio change indication means for indicating achange in variable magnification ratio while defining, as a maximumvalue, the maximum variable magnification ratio set by the maximumvariable magnification ratio setting means, wherein the maximum variablemagnification ratio setting means sets, as the maximum variablemagnification ratio, a maximum variable magnification ratio candidateselected by a user from a plurality of types of maximum variablemagnification ratio candidates, and the variable magnification ratiochange indication means indicates, as a boundary line, a value of amaximum variable magnification ratio candidate whose variablemagnification ratio is lower than that of the maximum variablemagnification ratio.

According to yet further aspect of the present invention, a signalprocessing method of changing a magnification ratio of an image acquiredby image sensing means, characterized by comprising: a first signalprocessing step of executing first signal processing for reducing animage sensing signal with respect to a scanning range of an obtainedimage sensing surface when the magnification ratio of the image is to beincreased; a second signal processing step of executing second signalprocessing different from the first signal processing step to change themagnification ratio of the image; a first detection step of detectingselection of one of a telephoto side and a wide-angle side; a seconddetection step of detecting a limit of an increase in magnificationratio of the image by the first signal processing step; and selectionstep of selecting one of a first mode and a second mode; wherein in theselection step, when the first mode is selected, and it is detected inthe first detection step that the telephoto side is continuouslyselected, the first signal processing is executed, and when it isdetected in the second detection step that the increase in magnificationratio of the image by the first signal processing has reached the limit,the second signal processing is subsequently executed to enlarge theimage, and when the second mode is selected, even when it is detected inthe second detection step that the increase in magnification ratio ofthe image by the first signal processing has reached the limit, and itis then detected in the first detection step that movement from thewide-angle side to the telephoto side is continuously selected, thesecond signal processing is inhibited.

According to another aspect of the present invention, an image datageneration method for generating image data on the basis of imagesensing data photographed by an image sensing element, characterized bycomprising: a recording mode control step of controlling a firstrecording mode in which image data in a first image format having afirst image size corresponding to the number of pixels of the imagesensing element is generated and recorded, and a second recording modein which image data in a second image format having a second image sizesmaller than the first image size is generated and recorded; anelectronic variable magnification step of executing electronic variablemagnification processing in generating the image data in the secondimage format in the second recording mode; a maximum variablemagnification ratio setting step of setting a maximum variablemagnification ratio in the electronic variable magnification step; and avariable magnification ratio change indication step of indicating achange in variable magnification ratio while defining, as a maximumvalue, the maximum variable magnification ratio set in the maximumvariable magnification ratio setting step, wherein in the maximumvariable magnification ratio setting step, a maximum variablemagnification ratio candidate selected by a user from a plurality oftypes of maximum variable magnification ratio candidates is set as themaximum variable magnification ratio, and in the variable magnificationratio change indication step, a value of a maximum variablemagnification ratio candidate whose variable magnification ratio islower than that of the maximum variable magnification ratio is indicatedas a boundary line.

According to another aspect of the present invention, a program for asignal processing apparatus which changes a magnification ratio of animage acquired by image sensing means, characterized by comprising: afirst signal processing step of executing first signal processing forreducing an image sensing signal with respect to a scanning range of anobtained image sensing surface when the magnification ratio of the imageis to be increased; a second signal processing step of executing secondsignal processing different from the first signal processing step tochange the magnification ratio of the image; a first detection step ofdetecting selection of one of a telephoto side and a wide-angle side; asecond detection step of detecting a limit of an increase inmagnification ratio of the image by the first signal processing step;and selection step of selecting one of a first mode and a second mode;wherein the signal processing apparatus is caused to, in the selectionstep, when the first mode is selected, and it is detected in the firstdetection step that the telephoto side is continuously selected, executethe first signal processing, and when it is detected in the seconddetection step that the increase in magnification ratio of the image bythe first signal processing has reached the limit, subsequently executethe second signal processing to enlarge the image, and when the secondmode is selected, even when it is detected in the second detection stepthat the increase in magnification ratio of the image by the firstsignal processing has reached the limit, and it is then detected in thefirst detection step that movement from the wide-angle side to thetelephoto side is continuously selected, inhibit the second signalprocessing.

According to still another aspect of the present invention, a programfor an image data generation apparatus which generates image data on thebasis of image sensing data photographed by an image sensing element,characterized by comprising: a recording mode control step ofcontrolling a first recording mode in which image data in a first imageformat having a first image size corresponding to the number of pixelsof the image sensing element is generated and recorded, and a secondrecording mode in which image data in a second image format having asecond image size smaller than the first image size is generated andrecorded; an electronic variable magnification step of executingelectronic variable magnification processing in generating the imagedata in the second image format in the second recording mode; a maximumvariable magnification ratio setting step of setting a maximum variablemagnification ratio in the electronic variable magnification step; and avariable magnification ratio change indication step of indicating achange in variable magnification ratio while defining, as a maximumvalue, the maximum variable magnification ratio set in the maximumvariable magnification ratio setting step, wherein the image datageneration apparatus is caused to, in the maximum variable magnificationratio setting step, setting, as the maximum variable magnificationratio, a maximum variable magnification ratio candidate selected by auser from a plurality of types of maximum variable magnification ratiocandidates, and in the variable magnification ratio change indicationstep, indicating, as a boundary line, a value of a maximum variablemagnification ratio candidate whose variable magnification ratio islower than that of the maximum variable magnification ratio.

According to another aspect of the present invention, an image sensingapparatus which has an optical zoom function and an electrical zoomfunction and in which a sensed image at a photographing magnificationratio covered by the optical zoom function is recorded as a reducedimage obtained by reducing the sensed image to an image having apredetermined number of pixels smaller than the number of pixels of thesensed image, and when photographing at a magnification ratio more thana maximum photographing magnification ratio covered by the optical zoomfunction is instructed, an image generated from the sensed image byusing the electrical zoom function is recorded, characterized bycomprising: storage means for storing a set value representing, ofphotographing magnification ratios that the electrical zoom functioncopes with, a maximum magnification ratio to be used in image sensing;first electrical zoom means for extracting the image having thepredetermined number of pixels from the sensed image to obtain anenlarged image; second electrical zoom means for extracting a partialimage of the enlarged image and enlarging the partial image to the imagehaving the predetermined number of pixels to obtain an enlarged image;and switching means for switching, in accordance with the set value,between image sensing which is to be executed by using both of the firstelectrical zoom means and the second electrical zoom means and imagesensing which is to be executed by using only the first electrical zoommeans.

Other features and advantages of the present invention will be apparentfrom the following description taken in conjunction with theaccompanying drawings, in which like reference characters designate thesame or similar parts throughout the figures thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate embodiments of the invention and,together with the description, serve to explain the principles of theinvention.

FIG. 1 is a block diagram showing the schematic arrangement of a digitalvideo camera according to the first embodiment of the present invention;

FIG. 2 is a block diagram showing details of a camera signal processingcircuit 104 shown in FIG. 1;

FIG. 3 is a block diagram showing the schematic arrangement of areduction processing circuit 205 shown in FIG. 2;

FIG. 4 is a graph showing a setting example of a variable spatial LPF inthe horizontal direction corresponding to the reduction ratio;

FIG. 5 is a block diagram showing the schematic arrangement of anenlargement processing circuit 206 shown in FIG. 2;

FIG. 6 is a graph showing a control example in which the gain of an edgeenhancement signal in aperture correction processing is increased inproportion to the enlargement ratio;

FIG. 7 is a block diagram showing the schematic arrangement of avariable magnification processing circuit 204 a which has an arrangementdifferent from that of the variable magnification processing circuit 204shown in FIGS. 2, 3, and 5;

FIG. 8 is a view showing the outline of still image/moving image modechange in the digital video camera shown in FIG. 1;

FIG. 9 is a view showing the outline of a zoom operation in the secondrecording mode in the digital video camera shown in FIG. 1;

FIG. 10 is a view showing an example of zoom magnification ratioindication on a viewfinder 114 in which a photographing image isconfirmed;

FIGS. 11A to 11C are views showing display examples of boundary linesbetween variable magnification ratios on a zoom magnification ratioindicator 1001;

FIGS. 12A to 12C are views showing examples of the zoom magnificationratio indicator 1001 different from FIGS. 11A to 11C;

FIG. 13 is a view showing a detailed example of a maximum magnificationratio selection switch 111;

FIG. 14 is a flow chart showing the operation flow of zoom processingcorresponding to mode setting in the digital video camera according tothe first embodiment;

FIG. 15 is a flow chart showing the operation flow of zoom processingcorresponding to mode setting in the digital video camera according tothe first embodiment;

FIG. 16 is a flow chart showing the operation flow of zoom processingcorresponding to mode setting in the digital video camera according tothe first embodiment;

FIG. 17 is a block diagram showing the schematic arrangement of adigital video camera according to the second embodiment of the presentinvention;

FIG. 18 is a block diagram for explaining details of a camera signalprocessing circuit 104 a shown in FIG. 17;

FIG. 19 is a view showing the outline of zoom processing in a secondphotographing mode;

FIG. 20 is a block diagram showing the schematic arrangement of adigital video camera according to the third embodiment of the presentinvention;

FIG. 21 is a block diagram for explaining details of a camera signalprocessing circuit 104 b shown in FIG. 20;

FIG. 22 is a view showing the outline of a zoom processing operation inthe digital video camera shown in FIG. 20;

FIGS. 23A and 23B are views showing examples of zoom magnification ratioindication on a viewfinder 114 in which a photographing image isconfirmed;

FIGS. 24A and 24B are views showing examples of a zoom magnificationratio indicator 2000 different from FIGS. 23A and 23B;

FIG. 25 is a view showing a detailed example of a maximum magnificationratio selection switch 111 a;

FIG. 26 is a block diagram showing the schematic arrangement of aconventional image recording apparatus having an optical zoom functionand an electrical zoom function; and

FIG. 27 is a view showing the optical zoom and electrical zoomoperations in the image recording apparatus shown in FIG. 26.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Preferred embodiments of the present invention will now be described indetail in accordance with the accompanying drawings.

The schematic arrangement of a digital video camera (an image recordingapparatus, signal processing apparatus, or image data generationapparatus) according to the first embodiment of the present inventionwill be described first. The digital video camera of this embodiment canphotograph both a still image and a moving image.

FIG. 1 is a block diagram showing the schematic arrangement of thedigital video camera according to the first embodiment of the presentinvention. Referring to FIG. 1, a lens optical system 101 includes anoptical lens which forms an image of incident light on an image sensingelement 102, an aperture, a focus controller, various kinds of opticalfilters, and a driving mechanism for them. The lens optical system 101can execute optical zoom for optically changing the view angle andincludes a driving mechanism for it. The above-described opticalmechanism in the lens optical system 101 of the digital video camerashown in FIG. 1 is a common mechanism, and a detailed descriptionthereof will be omitted.

The image sensing element 102 converts the optical signal of an imageformed on the light-receiving surface by the lens optical system 101into an electrical signal. Examples of the image sensing element 102 area CCD (Charge Coupled Device) and a CMOS (Complementary Metal OxideSemiconductor) sensor. An A/D (Analog/Digital) circuit 103analog/digital-converts the image sensing signal, which has beenconverted into an electrical signal by the image sensing element, intodigital image sensing data (to be referred to as image sensing datahereinafter). At this point of time, the image sensing data is digitaldata in an output format unique to the image sensing element 102 (theoutput format changes depending on the pixel array, the color filterarray, and the pixel charge read method).

A camera signal processing circuit 104 executes various processingoperations for converting the image sensing data supplied from the A/Dcircuit 103 into image data. The camera signal processing circuit 104also controls the optical zoom driving mechanism of the lens opticalsystem 101 to execute optical zoom. The processing executed by thecamera signal processing circuit 104 will be described later in detail.A recording signal processing circuit 105 executes compression-coding,recording format generation, error-correcting coding, or recordingmodulation coding for the image data converted by the camera signalprocessing circuit 104. The recording signal processing circuit 105outputs recording image data to be recorded in a recording medium. Arecording medium 106 records the recording image data generated by therecording signal processing circuit 105. Examples of the recordingmedium 106 are a flexible disk and a magnetic tape.

A recording mode switch 107 can be switched by a user to set a recordingmode. In a recording mode of this embodiment, the type of image data tobe recorded is switched between still image data and moving image data,or the recording image size is changed. A recording mode control circuit108 controls the contents of processing by the driving circuit of theimage sensing element 102, the camera signal processing circuit 104, andthe recording signal processing circuit 105 in accordance with thesetting of the recording mode switch 107. The processing in therecording mode control circuit 108 will be described later in detail.

A maximum magnification ratio setting circuit 109 sets the maximummagnification ratio in a zoom operation in accordance with the settingof a maximum magnification ratio selection switch 111. The setting bythe maximum magnification ratio setting circuit 109 will be describedlater in detail. A zoom magnification ratio indication circuit 110displays information related to the zoom magnification ratio on aviewfinder 114 (to be described later). More specifically, as shown inFIG. 10, a character representing the current zoom magnification ratiois displayed (displayed as an indicator) on a scale representing themaximum wide-angle state and the maximum telephoto state. FIG. 10 willbe described later in detail. With a zoom operation key 112, theoperator inputs the zoom operation between the wide-angle state and thetelephoto state.

A display control circuit 113 displays an image, which is beingphotographed, on the viewfinder 114 on the basis of image data outputfrom the camera signal processing circuit 104, or displays the zoommagnification ratio for the zoom magnification ratio indication circuit110 on the viewfinder 114. The viewfinder 114 is a display circuit onwhich various kinds of information are displayed under the control ofthe display control circuit 113. An example of the viewfinder 114 is aliquid crystal display circuit.

The digital video camera shown in FIG. 1 comprises not only thecomponents shown in FIG. 1 but also constituent components prepared incommon digital video cameras, including a system controller, a recordingmedium driving circuit, and a user interface circuit. However, theseconstituent components are unnecessary for the description of theembodiment of the present invention and therefore are not illustrated.

The processing in the recording mode control circuit 108 in the digitalvideo camera shown in FIG. 1 will be described in detail. The digitalvideo camera shown in FIG. 1 has a still image mode in which a stillimage is photographed and a moving image mode in which a moving image isphotographed, as described above. When the operator switches therecording mode switch 107, the mode can be changed between the stillimage mode and the moving image mode under the control of the recordingmode control circuit 108. FIG. 8 is a view showing the outline of stillimage/moving image mode change in the digital video camera shown in FIG.1.

Referring to FIG. 8, a sensing image size 801 represents the image sizeof image sensing data obtained by causing the A/D circuit 103 to convertan image sensing signal output from the image sensing element 102 intodigital data. A still image size 802 represents the image size of stillimage data which is generated by the digital video camera on the basisof image sensing data when the recording mode is the still image mode. Amoving image size 803 represents the image size of moving image datawhich is generated by the digital video camera on the basis of imagesensing data when the recording mode is the moving image mode.

An image size is defined by the total number of pixel data contained inimage data. As shown in FIG. 8, for the still image size 802, camerasignal processing is executed in the same image size as the sensingimage size 801. However, for the moving image size 803, camera signalprocessing is executed in an image size obtained by reducing the sensingimage size 801 in accordance with the moving image data format.

The reason why image size reduction processing is necessary in themoving image mode, as described above, will be described below. In,e.g., a digital video format (to be referred to as a DV formathereinafter), the image size of moving image data is predetermined. Forthis reason, if the image size of image sensing data is larger than thepredetermined size, the image data must be reduced to the predeterminedsize. Hence, the digital video camera shown in FIG. 1 reduces image datato the image size corresponding to the DV format in the moving imagemode.

To the contrary, the image size of still image data photographed in thestill image mode is not particularly predetermined in the still imageformat. Still image data can be recorded up to the maximum image sizedefined by each digital video camera.

An example of the driving processing of the image sensing element 102corresponding to switching between the still image mode and the movingimage mode described above is switching between a cumulative read in themoving image mode and a non-cumulative read in the still image mode. Inaddition, as the processing by the recording signal processing circuit105 corresponding to switching between the still image mode and themoving image mode, switching is executed between compression-coding,recording format generation, error-correcting coding, and modulationcoding corresponding to each of the DV format and still image formatdefined by setting the still or moving image mode.

In the following description, the first recording mode is the stillimage mode, and the second recording mode is the moving image mode. Thefirst and second recording modes are not limited to the above-describedmodes and can be two recording modes using different electronicenlargement/reduction processes. For example, the first recording modeis the above-described mode (still image mode), and the second recordingmode may be a still image reduction recording mode in which still imagedata is electronically reduced.

The camera signal processing circuit 104 shown in FIG. 1 will bedescribed next in detail.

FIG. 2 is a block diagram showing details of the camera signalprocessing circuit 104 shown in FIG. 1. Referring to FIG. 2, an imagesensing data input terminal 201 is connected to the output terminal ofthe A/D circuit 103 to receive image sensing data output from the A/Dcircuit 103. A memory 1 (202) is a storage circuit which holds the imagesensing data input to the image sensing data input terminal 201. Theimage sensing data held in the memory 1 (202) has a format which changesdepending on the structure or driving method of the image sensingelement 102, as described above. An example of the format of the imagesensing data is a data format determined by the color filter array of acolor image sensing element.

An image sensing signal processing circuit 203 converts the imagesensing data held in the memory 1 (202) into an image data format forrecording or an intermediate image data format for the next processing.More specifically, since image sensing element 102 of this embodiment isa color image sensing element, the image sensing signal processingcircuit 203 executes matrix conversion processing from the image sensingdata to image data in the RGB format or image data in the Y(R-Y)(B-Y)format, interpolation processing for the color filter array, whitebalance processing, and γ conversion processing. The conversionparameters of these processing operations are controlled by recordingmode data supplied from a recording mode input terminal 210 (to bedescribed later).

A variable magnification processing circuit 204 executesenlargement/reduction processing for the image data output from theimage sensing signal processing circuit 203 and outputs the variablymagnified image data. More specifically, the variable magnificationprocessing circuit 204 comprises a reduction processing circuit 205,enlargement processing circuit 206, and variable magnificationprocessing selection circuit 207. The reduction processing circuit 205executes reduction processing for the image data and outputs reducedimage data. It is detected whether the reduction processing for theimage data has reached its limit. If it is detected that the reductionprocessing for the image data has reached the limit, the enlargementprocessing circuit 206 executes enlargement processing for the imagedata and outputs enlarged image data. The variable magnificationprocessing selection circuit 207 selects one of the image data, reducedimage data, and enlarged image data in accordance with the mode andoutputs variably magnified image data. A memory 2 (208) holds thevariable magnified image data output from the variable magnificationprocessing circuit 204. A terminal 209 outputs the variably magnifiedimage data (image data in the second image format) held in the memory 2.

Recording mode data from the recording mode control circuit 108 shown inFIG. 1 is input to the recording mode input terminal 210 (to be referredto as the terminal 210 hereinafter). More specifically, recording modedata which designates the first recording mode (still image recordingmode) or the second recording mode (moving image mode) is input. Theabove-described image sensing signal processing circuit 203 executessignal processing corresponding to the recording mode data input fromthe terminal 210. More specifically, the image sensing signal processingcircuit 203 executes processing for generating still image data from theimage sensing data in accordance with the first recording mode (stillimage mode) or processing for generating reduced moving image data fromthe image sensing data in accordance with the second recording mode(moving image mode). A zoom control circuit 211 and an electronicvariable magnification control circuit 212 (both will be describedlater) control a zoom operation corresponding to the recording mode datainput from the terminal 210.

The zoom control circuit 211 determines the zoom magnification ratio inaccordance with zoom operation key input data from a zoom operation keyinput terminal 213 (to be referred to as a terminal 213 hereinafter) andcontrols an optical zoom control circuit 216 (to be described later) andthe electronic variable magnification control circuit 212 in a modecorresponding to the determined zoom magnification ratio to execute thezoom operation. The electronic variable magnification control circuit212 controls variable magnification processing by the variablemagnification processing circuit 204 in accordance with an instructionfrom the zoom control circuit 211. The electronic variable magnificationcontrol circuit 212 also controls the method of reading cut the imagesensing data from the memory 1 (202), as needed. The processing in thezoom control circuit 211 and electronic variable magnification controlcircuit 212 will be described later in detail.

A maximum magnification ratio selection value by the maximummagnification ratio setting circuit 109 shown in FIG. 1 is input to amaximum magnification ratio selection input terminal 214 (to be referredto as a terminal 214 hereinafter). The maximum magnification ratioselection value input to the terminal 214 is processed by the zoomcontrol circuit 211 in accordance with the mode corresponding to theselection value. A zoom magnification ratio indication output terminal215 (to be referred to as a terminal 215 hereinafter) is connected tothe input terminal of the zoom magnification ratio indication circuit110 to output zoom magnification ratio indication data to it. Theoptical zoom control circuit 216 executes optical zoom by controllingthe lens optical system 101 in accordance with an instruction from thezoom control circuit 211. An optical zoom output terminal 217 (to bereferred to as a terminal 217 hereinafter) is connected to the lensoptical system 101 to output optical zoom data, which is output from theoptical zoom control circuit 216 to control the optical zoom processing,to the lens optical system 101.

With the above arrangement, the camera signal processing circuit 104converts image sensing data into still image data in the still imageformat in accordance with the first recording mode, converts imagesensing data into moving image data in the moving image format inaccordance with the second recording mode, or executes processingrelated to optical zoom or electrical zoom.

The arrangement of the reduction processing circuit (a first electronicvariable magnification means serving as a first signal processing means)205 shown in FIG. 2 will be described next. FIG. 3 is a block diagramshowing the schematic arrangement of the reduction processing circuit205 shown in FIG. 2. Referring to FIG. 3, an input terminal 301 isconnected to the electronic variable magnification control circuit 212shown in FIG. 2 to receive electronic variable magnification controldata from it. A reduction control circuit 302 specifies the variablemagnification ratio from the electronic variable magnification controldata which corresponds to the mode and is input from the electronicvariable magnification control circuit 212 through the input terminal301. The reduction control circuit 302 controls an LPF (Low-Pass Filter)coefficient setting circuit 304 (to be described later) in accordancewith the variable magnification ratio. The reduction control circuit 302also controls a down-sampling circuit 306 (to be described later) inaccordance with the variable magnification ratio.

An input terminal 303 is connected to the image sensing signalprocessing circuit 203 shown in FIG. 2 to receive image data from it. Avariable spatial LPF (Low-Pass Filter) 305 limiting the band of theimage data input from the image sensing signal processing circuit 203through the input terminal 303 to prevent aliasing (aliasing of ahigh-frequency component) due to reduction processing. The LPFcoefficient setting circuit 304 sets an LPF coefficient corresponding tothe reduction ratio in the variable spatial LPF 305 under the control ofthe reduction control circuit 302.

An example of a method of setting an LPF coefficient corresponding to areduction ratio will be described. FIG. 4 is a graph showing a settingexample of a variable spatial LPF in the horizontal directioncorresponding to the reduction ratio. Generally, aliasing can beprevented by band limit up to a frequency equivalent to the Nyquistfrequency after reduction. For this reason, a horizontal spatialfrequency to be band-limited is defined in accordance with the reductionratio, thereby setting the LPF characteristic. More specifically, asshown in FIG. 4, the LPF characteristic is set such that the lower thereduction ratio becomes, the smaller the band of the horizontal spatialfrequency becomes.

The down-sampling circuit 306 executes reduction processing for theimage data band-limited by the variable spatial LPF 305 on the basis ofthe variable magnification ratio from the reduction control circuit 302.An output terminal 307 outputs the reduced image data output from thedown-sampling circuit 306. The output terminal 307 is connected to theinput side of the recording signal processing circuit 105. As thedigital image data reduction method in the reduction processing circuit205, a general reduction method such as a reduction method by Bi-Cubicinterpolation using a secondary re-sampling filter can suitably be used.

The arrangement of the enlargement processing circuit (a secondelectronic variable magnification means serving as a second signalprocessing means) 206 shown in FIG. 2 will be described next. FIG. 5 isa block diagram showing the schematic arrangement of the enlargementprocessing circuit 206 shown in FIG. 2. An input terminal 501 isconnected to the electronic variable magnification control circuit 212shown in FIG. 2 to receive electronic variable magnification controldata from it. An enlargement control circuit 502 specifies theenlargement ratio from the electronic variable magnification controldata input from the electronic variable magnification control circuit212 shown in FIG. 2 through the input terminal 501. The enlargementcontrol circuit 502 controls an up-sampling circuit 504 and a correctioncoefficient setting circuit 505 (both will be described later) inaccordance with the enlargement ratio.

An input terminal 503 is connected to the image sensing signalprocessing circuit 203 shown in FIG. 2 to receive image data from it.The up-sampling circuit 504 executes enlargement processing for theimage data input from the input terminal 503 in accordance with theenlargement ratio from the enlargement control circuit 502. As thedigital image data enlargement method in the enlargement processingcircuit 206, a general enlargement method such as an enlargement methodby Bi-Cubic interpolation using a 2nd-order re-sampling filter cansuitably be used.

The correction coefficient setting circuit 505 sets a correctioncoefficient to be used by an aperture correction circuit 506 (to bedescribed later) in accordance with the enlargement ratio from theenlargement control circuit 502. The aperture correction circuit 506executes aperture correction processing for correcting the degradationin sharpness of the image due to enlargement processing. As a detailedexample of aperture correction processing, an edge enhancement signal isobtained by separating the edge component of the image, multiplied by apredetermined gain, and added to the original image. As described above,the enlargement control circuit 502 controls the up-sampling circuit 504and also controls the correction coefficient setting circuit 505 inaccordance with the variable magnification ratio to control thecharacteristic of the aperture correction circuit 506.

The relationship between aperture correction processing and anenlargement ratio will be described. FIG. 6 is a graph showing a controlexample in which the gain of an edge enhancement signal in aperturecorrection processing is increased in proportion to the enlargementratio. The correction coefficient setting circuit 505 sets, for theaperture correction circuit 506, a correction coefficient whichincreases the gain of an edge enhancement signal in proportion to theenlargement ratio, as shown in FIG. 6. That is, the enlargement controlcircuit 502 controls the correction coefficient setting circuit 505 tocause it to set a correction coefficient proportional to the enlargementratio.

The zoom operation in the second recording mode (moving image mode) inthe digital video camera shown in FIG. 1 will be described next. In thefollowing description, the photographing range of an object (the rangeof an object in image data to be recorded in the recording medium 106)is the view angle.

FIG. 9 is a view showing the outline of an image magnification ratio andthe zoom operation in the second recording mode in the digital videocamera shown in FIG. 1. Referring to FIG. 9, a frame 901 indicates aview angle when optical zoom is in the maximum telephoto state. Inelectrical zoom according to this embodiment, the image sensing element102 and memory 1 (202) process image sensing data having an image sizecorresponding to the frame 901. More specifically, the charge read range(scanning range) on the surface (image sensing surface) of the effectivepixel region in the image sensing element 102 is the range indicated bythe frame 901.

A frame 902 indicates a view angle at which variable magnificationprocessing at a magnification ratio of ×1 can be executed in the secondrecording mode. The frame 902 indicates an image area corresponding tothe recording image size, which is extracted, in the second recordingmode, from the image sensing data within the image sensing rangeindicated by the frame 901. A frame 903 indicates a view angle largerthan the frame 901 when optical zoom is in the maximum wide-angle state.A frame 904 indicates a view angle in enlargement processing as thesecond signal processing by electrical zoom. The frame 904 indicates animage area to be enlarged in the image sensing data having the viewangle indicated by the frame 901. As indicated by the frames 901 to 904,the view angle increases toward the wide-angle side and decreases towardthe telephoto side. In other words, the image becomes smaller toward thewide-angle side and larger toward the telephoto side.

A recording image 905 in the wide-angle state is the image of movingimage data which is recorded in the recording medium 106 at the viewangle indicated by the frame 903. A recording image 906 in the maximumtelephoto state of optical zoom is the image of moving image data whichis recorded in the recording medium 106 at the view angle indicated bythe frame 901. A recording image 907 when the image sensing data isprocessed at a magnification ratio of ×1 is the image of moving imagedata which is recorded in the recording medium 106 at the view angleindicated by the frame 902. A recording image 908 in enlargementprocessing by electrical zoom is the image of moving image data which isrecorded in the recording medium 106 at the view angle indicated by theframe 904. The sizes of the recording images 905 to 908 correspond tothe image sizes of the moving image data, which are image sizes definedby the DV format. As indicated by the recording images 905 to 908, onthe basis of image sensing data within the processing range whichchanges in accordance with a change in view angle, moving image datahaving an image size defined by a predetermined format is generated andrecorded on the recording medium 106.

In the digital video camera, the above-described change in view anglefrom the frame 903 to the frame 901 is implemented by controlling thelens optical system 101. This view angle change region corresponds to anoptical zoom region 910 shown in FIG. 9. The above-described change inview angle from the frame 901 to the frame 902 is implemented byelectrical zoom processing (reduction processing) by the camera signalprocessing circuit 104. This view angle change region corresponds to anelectrical zoom 1 region 911 shown in FIG. 9. The above-described changein view angle from the frame 902 to the frame 904 is implemented byelectrical zoom processing (enlargement processing as second signalprocessing) by the camera signal processing circuit 104. This view anglechange region corresponds to an electrical zoom 2 region 912 shown inFIG. 9.

As shown even in FIG. 8, in the second recording mode of the digitalvideo camera according to this embodiment, the image size of imagesensing data is reduced, and the image data is recorded as moving imagedata. Hence, electronic variable magnification processing (reductionprocessing as first signal processing) is executed even in the opticalzoom region 910. More specifically, from the maximum telephoto state tothe maximum wide-angle state of optical zoom in the optical zoom region910, optical zooming by the lens optical system 101 is performed under apredetermined electronic magnification (reduction) ratio. The image sizeof the recording image 907 is the same as that extracted from the imagesensing data, as indicated by the frame 902. In this case, since theextracted size equals the recording size, electronic variablemagnification ratio=1 (×1).

The variable magnification processing circuit 207 detects that theelectronic variable magnification (reduction) ratio has reached thelimit. When electronic variable magnification ratio=1, this circuitdetects that the electronic variable magnification (reduction) ratio hasreached the limit. For example, this corresponds to a case wherein animage having 320×240 pixels should be generated, and image sensing datacorresponding to 320×240 pixels is acquired. The circuit may be designedto detect that the electronic variable magnification (reduction) ratiohas reached the limit when the electronic variable magnification ratiohas reached a predetermined value approximate to electronic variablemagnification ratio=1.

In this embodiment, for the descriptive convenience, electronic variablemagnification ratio=1 applies to both the horizontal and verticaldirections. However, the present invention is not limited to this. Forexample, when the second recording mode is a DV format recording mode,sampling is done on the basis of a moving image data standard except asquare matrix, and the image sensing element 102 has a square matrix,processing at a magnification ratio of ×1 is executed in one of thehorizontal and vertical directions. For the other direction, adjustmentby electronic variable magnification processing is necessary (≠×1)

As indicated by the electrical zoom 1 region 911, from the frame 901 inthe maximum telephoto state of optical zoom to the frame 902corresponding to extraction at a magnification ratio of ×1, theelectrical zoom effect is obtained by changing the extraction image sizein accordance with electronic variable magnification (reduction)processing such that a predetermined recording image size can beobtained. When the view angle changes from the frame 902 to the frame904, it means that extraction image size is smaller than recording imagesize. In this case, enlargement processing is executed. That is, anelectronic variable magnification ratio is larger than 1. Morespecifically, from the frame 902 corresponding to extraction at amagnification ratio of ×1 to the frame 904 corresponding to the upperlimit (maximum magnification ratio) of electrical zoom, the electricalzoom effect is obtained by changing the extraction image size inaccordance with electronic variable magnification (enlargement)processing for a predetermined recording image size.

Processing of a maximum magnification ratio selection value which isinput from the maximum magnification ratio setting circuit 109 shown inFIG. 1 to the terminal 214 shown in FIG. 2 will be described next. Thezoom magnification ratio control circuit 211 changes the control methodof the optical zoom control circuit 216 and electronic variablemagnification control circuit 212 in a mode corresponding to the maximummagnification ratio selection value input to the terminal 214, therebychanging the zoom control range by zoom operation key input. A settingexample of the maximum magnification ratio selection value will bedescribed here by using a detailed example of the maximum magnificationratio selection switch 111. FIG. 13 is a view showing a detailed exampleof the maximum magnification ratio selection switch 111. As shown inFIG. 13, the maximum magnification ratio selection switch 111 is amaximum magnification ratio setting menu by, e.g., a GUI (Graphical UserInterface) displayed on the viewfinder 114 of the digital video camera.This can be implemented by mounting, in the digital video camera, aprogram which implements the above-described GUI and a CPU whichexecutes the program.

Referring to FIG. 13, a setting menu item display 1301 contains settingmenu items such as “camera shake correction”, “electrical zoom”, and“white balance”. An electrical zoom setting item 1302 is a list ofsetting items related to the electrical zoom function (in this example,the maximum variable magnification ratio), including three items “OFF”,“×2” and “×8”. The electrical zoom setting item 1302 is displayed byselecting “electrical zoom” in the setting menu item display 1301.Referring to FIG. 13, “electrical zoom” in the setting menu item display1301 is selected, as indicated by an arrow 1303. Referring to FIG. 13,“×2” as the second mode in the electrical zoom setting item 1302 isselected, as indicated by an arrow 1304.

The operator of the digital video camera selects the “electrical zoom”menu, i.e., the maximum magnification ratio selection item, from thesetting menu item display 1301 by moving the arrow 1303.

With this operation, a mode is set. This operation can be expressed bythe flows shown in FIGS. 14, 15, and 16. As shown in FIG. 14, first, amagnification ratio is set (a mode is set), as described above (stepS1). Accordingly, the electrical zoom setting item 1302 is displayed.After that, the camera signal processing circuit 104 issues aninstruction to set the magnification ratio to the wide-angle side(initialization) (step S2).

When the item “OFF” in the electrical zoom setting item 1302 isselected, only the optical zoom region 910 shown in FIG. 9 is used. Thatis, photographing can be executed from the recording image 905 to therecording image 906 in FIG. 9.

When the item “×2” as the second mode is selected (NO in step S3 andstep S4), the optical zoom region 910 and electrical zoom 1 region(reduction mode region) 911 in FIG. 9 are used. In this case,photographing can be executed from the recording image 905 to therecording image 907. As shown in FIG. 15, when it is detected thatmovement from the wide-angle side to the telephoto side is selected bythe zoom operation key 112 (step S5), the variable magnificationprocessing circuit 204 executes reduction processing as first signalprocessing under the control of the zoom control circuit (step S6). Ifit is detected that the increase in image magnification ratio by thereduction processing has reached the limit (YES in step S7), theabove-described enlargement processing is inhibited (step S9) even whenit is continuously detected that movement from the wide-angle side tothe telephoto side is still selected by the zoom operation key 112 (YESin step S8). If it is not detected that the increase in imagemagnification ratio by the reduction processing in step S6 has reachedthe limit (NO in step S7), the flow returns to step S5 to detect theoperation (telephoto or wide-angle) of the zoom operation key 112. IfYES in step S7, and it is not detected that movement from the wide-angleside to the telephoto side is still selected by the zoom operation key112 (NO in step S8), the flow returns to step S5.

When the item “×8” as the first mode is selected (YES in step S3), theoptical zoom region 910, electrical zoom 1 region (reduction mode regionas the first mode) 911, and electrical zoom 2 region (enlargement moderegion as the second mode) 912 in FIG. 9 are used. In this case,photographing can be executed from the recording image 905 to therecording image 908. As shown in FIG. 14, when it is detected thatmovement from the wide-angle side to the telephoto side is selected bythe zoom operation key 112 (step S13), the variable magnificationprocessing circuit 204 executes reduction processing as first signalprocessing under the control of the zoom control circuit (step S14). Ifit is detected that the increase in image magnification ratio by thereduction processing has reached the limit (YES in step S15), and it isdetected that movement from the wide-angle side to the telephoto side isstill selected by the zoom operation key 112 (YES in step S16), theabove-described enlargement processing is executed as second signalprocessing shown in FIG. 16 (step S17). If it is not detected that theincrease in image magnification ratio by the reduction processing instep S14 has reached the limit (NO in step S15), the flow returns tostep S13 to detect the operation (telephoto or wide-angle) of the zoomoperation key 112. If YES in step S15, and it is not detected thatmovement from the wide-angle side to the telephoto side is stillselected by the zoom operation key 112 (NO in step S16), the flowreturns to step S13.

After processing in step S17 in FIG. 16, the telephoto state orwide-angle state is detected, and the second signal processing isrepeated (steps S18 and S19, NO in step S20, and NO in step S21). Whenthe magnification ratio returns to the limit value of the increase inmagnification ratio by the above-described reduction processing (YES instep S20), the flow returns to step S13 in FIG. 14 to start the flow offirst signal processing. Note that returning the magnification ratio tothe limit value of the increase in magnification ratio by the reductionprocessing means that the magnification ratio in the second signalprocessing reaches, by reduction processing, the limit on the firstsignal processing side (the side of the electrical zoom 1 region 911 inFIG. 9).

On the other hand, assume that the magnification ratio does not returnto the limit value of the increase in magnification ratio by theabove-described reduction processing (NO in step S20), it iscontinuously detected in step S18 that movement from the wide-angle sideto the telephoto side is still selected, and the magnification ratio hasreached the limit of the enlargement processing as the second signalprocessing (YES in step S21). In this case, even when it is continuouslydetected that movement from the wide-angle side to the telephoto side isselected by the zoom operation key 112 (YES in step S22), theabove-described enlargement processing as the second signal processingis inhibited (step S23). If it is continuously detected in step S18 thatmovement from the wide-angle side to the telephoto side is selected, andthe magnification ratio has not reached the limit of the enlargementprocessing as the second signal processing (NO in step S21), the flowreturns to step S18 to detect the operation (telephoto or wide-angle) ofthe zoom operation key 112. If YES in step S21, and it is not detectedthat movement from the wide-angle side to the telephoto side is selectedby the zoom operation key 112 (NO in step S22), the flow returns to stepS18.

As described above, by setting the maximum magnification ratio selectionswitch 111, the zoom magnification ratio “×2” until electronic variablemagnification is executed as the reduction operation under the controlof the zoom control circuit 211 can be selected as the maximum variablemagnification ratio so that the second mode can be selected and set.Accordingly, the operator can select and set a new zoom mode in whichelectronic enlargement processing causes no degradation in imagequality, and the zoom magnification ratio can be set higher than in onlyoptical zoom. In addition, the electronic variable magnification controlcircuit 212 controls the extraction area size in reading out imagesensing data from the variable magnification processing circuit 204 andmemory 1 (202) under the control of the zoom control circuit 211,thereby executing the electrical zoom operation forenlargement/reduction, as described above.

The variable magnification processing selection circuit 207 selects,under the control of the electronic variable magnification controlcircuit 212, the output from the reduction processing circuit 205 for avariable magnification ratio in the first signal processing in whichelectronic variable magnification is executed as reduction processing.The variable magnification processing selection circuit 207 selects theoutput from the enlargement processing circuit 206 for a variablemagnification ratio in the second signal processing in which electronicvariable magnification is executed as enlargement processing. For avariable magnification ratio in electronic variable magnification at amagnification ratio of ×1 (e.g., when an image having 320×240 pixelsshould be generated and recorded, and image sensing data correspondingto 320×240 pixels is acquired), the variable magnification processingselection circuit 207 selects the output from the image sensing signalprocessing circuit 203 without intervening variable magnificationprocessing. That is, the output from the reduction processing circuit205 is selected in the optical zoom region 910 and electrical zoom 1region 911. The output from the image sensing signal processing circuit203 is selected in extraction at a magnification ratio of ×1. The outputfrom the enlargement processing circuit 206 is selected in theelectrical zoom 2 region 912.

When the sampling matrix of the image sensing element 102 is differentfrom that in the recording mode, as described above, processing at amagnification ratio of ×1 is executed in one of the horizontal andvertical directions. For the other direction, electronic variablemagnification ratio≠1. In this case, even in the processing at amagnification ratio of ×1, horizontal or vertical electronic variablemagnification processing must be executed. In accordance with theelectronic variable magnification ratio, the output from the reductionprocessing circuit 205 or enlargement processing circuit 206 isselected.

The schematic arrangement of a variable magnification processing circuit204 a having an arrangement different from that of the variablemagnification processing circuit 204 shown in FIGS. 2, 3, and 5 will bedescribed next. FIG. 7 is a block diagram showing the schematicarrangement of the variable magnification processing circuit 204 a whichhas an arrangement different from that of the variable magnificationprocessing circuit 204 shown in FIGS. 2, 3, and 5. That is, the variablemagnification processing circuit 204 a shown in FIG. 7 may replace thevariable magnification processing circuit 204 shown in FIG. 2. Thevariable magnification processing circuit 204 a shown in FIG. 7 uses thesame re-sampling filter algorithm for enlargement and reduction. Theenlargement and reduction are switched only by controlling the variablemagnification coefficient so that the circuit has a simpler arrangementthan that of the variable magnification processing circuit 204 shown inFIG. 2.

Referring to FIG. 7, an input terminal 701 is connected to theelectronic variable magnification control circuit 212 shown in FIG. 2 toreceive electronic variable magnification control data from it. Avariable magnification control circuit 702 specifies the variablemagnification ratio from the electronic variable magnification controldata input from the electronic variable magnification control circuit212 through the input terminal 701 and controls a re-sampling filter 704(to be described later) in accordance with the variable magnificationratio. An input terminal 703 is connected to the image sensing signalprocessing circuit 203 shown in FIG. 2 to receive image data from it.The re-sampling filter 704 enlarges or reduces the image data input fromthe input terminal 703 in accordance with the variable magnificationratio input from the variable magnification control circuit 702.

An operation for causing the zoom control circuit 211 shown in FIG. 2 tosupply a zoom magnification ratio indication output corresponding to thezoom operation key input to the zoom magnification ratio indicationcircuit 110 shown in FIG. 1 and causing the viewfinder 114 to displaythe zoom magnification ratio, and display examples will be describednext. FIG. 10 is a view showing an example of zoom magnification ratioindication on the viewfinder 114 in which a photographing image isconfirmed. Referring to FIG. 10, a zoom magnification ratio indicator1001 includes an indicator 1002 which indicates the zoom magnificationratio during photographing by the digital video camera in a scale havingthe maximum wide-angle state and the maximum telephoto state at twoends. “W” represents the maximum wide-angle state, and “T” representsthe maximum telephoto state in FIG. 10. The indicator 1002 moves on thescale as the optical zoom magnification ratio or electrical zoommagnification ratio controlled by the zoom control circuit 211 changesin accordance with the zoom operation key input.

Display of boundary lines between variable magnification ratios on thezoom magnification ratio indicator 1001 will be described next. FIGS.11A to 11C are views showing display examples of boundary lines betweenvariable magnification ratios on the zoom magnification ratio indicator1001. FIG. 11A shows a display example of the zoom magnification ratioindicator 1001 when zooming can be executed in the optical zoom region910, electrical zoom 1 region 911, and electrical zoom 2 region 912shown in FIG. 9. At this time, setting by the maximum magnificationratio selection switch 111 corresponds to “×8” in the electrical zoomsetting item 1302 shown in FIG. 13. Referring to FIG. 11A, an indicator1101 indicates the current zoom magnification ratio. A boundary line1102 indicates the upper limit of optical zoom (the maximum wide-anglestate in the optical zoom region 910 in FIG. 9). A boundary line 1103indicates the upper limit of electrical zoom 1 (the boundary between theelectrical zoom 1 region 911 and the electrical zoom 2 region 912 inFIG. 9). The maximum telephoto state represented by “T” corresponds tothe recording image 908 in FIG. 9 when the maximum magnification ratiois “×8”.

FIG. 11B shows a display example of the zoom magnification ratioindicator 1001 when zooming can be executed in the optical zoom region910 and electrical zoom 1 region 911 shown in FIG. 9. At this time,setting by the maximum magnification ratio selection switch 111corresponds to “×2” in the electrical zoom setting item 1302 shown inFIG. 13. The maximum telephoto state represented by “T” corresponds tothe recording image 907 in FIG. 9 when the maximum magnification ratiois “×2”.

FIG. 11C shows a display example of the zoom magnification ratioindicator 1001 when zooming can be executed in the optical zoom region910 shown in FIG. 9. At this time, setting by the maximum magnificationratio selection switch 111 corresponds to “OFF” in the electrical zoomsetting item 1302 shown in FIG. 13. The maximum telephoto staterepresented by “T” corresponds to the recording image 906 (FIG. 9) inthe maximum telephoto state of optical zoom.

Examples of the zoom magnification ratio indicator 1001 different fromFIGS. 11A to 11C will be described next. FIGS. 12A to 12C are viewsshowing examples of the zoom magnification ratio indicator 1001different from FIGS. 11A to 11C. The zoom magnification ratio indicator1001 shown in FIGS. 11A to 11C can be scaled (i.e., the zoommagnification ratio indicator 1001 has a predetermined length). However,FIGS. 12A to 12C show display examples in which the scale of the zoommagnification ratio indicator 1001 is fixed (i.e., the length of thezoom magnification ratio indicator 1001 changes).

FIG. 12A shows a display example of the zoom magnification ratioindicator 1001 when zooming can be executed in the optical zoom region910, electrical zoom 1 region 911, and electrical zoom 2 region 912shown in FIG. 9. Referring to FIG. 12A, an indicator 1201 indicates thecurrent zoom magnification ratio. A boundary line 1202 indicates theupper limit of optical zoom (the maximum wide-angle state in the opticalzoom region 910 in FIG. 9). A boundary line 1203 indicates the upperlimit of electrical zoom 1 (the boundary between the electrical zoom 1region 911 and the electrical zoom 2 region 912 in FIG. 9). As describedabove, FIG. 12A corresponds to FIG. 11A described above, and the displayform and display contents are the same.

FIG. 12B shows a display example of the zoom magnification ratioindicator 1001 when zooming can be executed in the optical zoom region910 and electrical zoom 1 region 911 shown in FIG. 9. The zoommagnification ratio indicator 1001 shown in FIG. 12B is shorter thanthat in FIG. 12A (even that in FIG. 11B) by a length corresponding tothe electrical zoom 2 region 912.

FIG. 12C shows a display example of the zoom magnification ratioindicator 1001 when zooming can be executed in the optical zoom region910 shown in FIG. 9. The zoom magnification ratio indicator 1001 shownin FIG. 12C is shorter than that in FIG. 12A (even that in FIG. 11C) bya length corresponding to the electrical zoom 1 region 911 andelectrical zoom 2 region 912.

As described above, the zoom magnification ratio indicator 1001displayed on the viewfinder 114 can have an arbitrary shape. The zoommagnification ratio may also be indicated by a numerical value. When aboundary line is shown as described above, the user can be notified ofthe start of electrical zoom (reduction processing), the start ofelectrical zoom (enlargement processing), or the maximum magnificationratio set state.

As the second embodiment of the present invention, a digital videocamera (image recording apparatus) which also has a photographing modein which the zoom operation is performed only by an optical zoom meanswithout executing electronic variable magnification processing will bedescribed next.

FIG. 17 is a block diagram showing the schematic arrangement of adigital video camera according to the second embodiment of the presentinvention. The same reference numerals as in the digital video camerashown in FIG. 1 denote constituent components having the same functionsin the digital video camera shown in FIG. 17, and a description thereofwill be omitted. The digital video camera shown in FIG. 17 is differentfrom that shown in FIG. 1 in a ×1 magnification fixing switch 1413 and acamera signal processing circuit 104 a. The different parts will mainlybe described.

Referring to FIG. 17, the ×1 magnification fixing switch 1413 sets aphotographing mode (second photographing mode) in which the electronicvariable magnification ratio is fixed at ×1, and only optical zoom isused or a photographing mode (first photographing mode) in whichelectronic variable magnification is used. More specifically, when the×1 magnification fixing switch 1413 is set to the first photographingmode, the digital video camera of this embodiment executes the samephotographing operation as that of the digital video camera shown inFIG. 1. When the ×1 magnification fixing switch 1413 is set to thesecond photographing mode, the digital video camera of this embodimentexecutes a photographing operation unique to this embodiment. Thephotographing operation unique to this embodiment will be describedlater.

When the ×1 magnification fixing switch 1413 is set to the firstphotographing mode, the camera signal processing circuit 104 a has thesame function as that of the camera signal processing circuit 104 shownin FIG. 1 and executes various processing operations for convertingimage sensing data supplied from an A/D circuit 103 into image data, anda detailed description thereof will be omitted. When the ×1magnification fixing switch 1413 is set to the second photographingmode, the camera signal processing circuit 104 a executes zoomprocessing using only optical zoom, which is unique to this embodiment.In either photographing mode, the camera signal processing circuit 104 acontrols the optical zoom driving mechanism of a lens optical system 101to execute optical zooming. The digital video camera shown in FIG. 17comprises not only the constituent components shown in FIG. 17 but alsoconstituent components prepared in common digital video cameras,including a system controller, a recording medium driving circuit, and auser interface circuit. However, these constituent components areunnecessary for the description of the embodiment of the presentinvention and therefore are not illustrated.

The camera signal processing circuit 104 a shown in FIG. 17 will bedescribed next in detail. FIG. 18 is a block diagram for explainingdetails of the camera signal processing circuit 104 a shown in FIG. 17.As shown in FIG. 18, the camera signal processing circuit 104 a has thesame arrangement as that of the camera signal processing circuit 104shown in FIG. 2 except a ×1 magnification fixing input terminal 1516 (tobe referred to as an input 1516 hereinafter) and a zoom control circuit211 a, and a description of components having the same referencenumerals as in FIG. 2 will be omitted. In accordance with setting of the×1 magnification fixing switch 1413 input from the terminal 1516, thecamera signal processing circuit 104 a implements the secondphotographing mode in which the electronic variable magnification ratiois fixed at ×1, and only optical zoom is used.

More specifically, in the second photographing mode, the zoom controlcircuit 211 a in the camera signal processing circuit 104 a instructs anelectronic variable magnification control circuit 212 to executevariable magnification processing at a magnification ratio of ×1 andalso instructs an optical zoom control circuit 216 to execute zoomprocessing corresponding to the operation of the zoom operation key.Accordingly, the photographing mode in which the electronic variablemagnification ratio is fixed at ×1, and only optical zoom is used can beimplemented. At this time, a variable magnification processing selectioncircuit 207 selects the output from an image sensing signal processingcircuit 203, which is processed on the basis of image sensing dataextracted from a memory 1 (202) at a magnification ratio of ×1. Asdescribed above, when the sampling matrix of an image sensing element102 is different from that of the recording image format, as describedabove, processing at a magnification ratio of ×1 is executed in one ofthe horizontal and vertical directions. For the other direction,electronic variable magnification processing is executed. In this case,even in the processing at a magnification ratio of ×1, horizontal orvertical electronic variable magnification processing must be executed.In accordance with the electronic variable magnification ratio, theoutput from a reduction processing circuit 205 or enlargement processingcircuit 206 is selected. The circuit and variable magnification ratioare fixed once they are selected by the variable magnificationprocessing selection circuit 207.

Zoom processing in the second photographing mode will be described here.

FIG. 19 is a view showing the outline of zoom processing in the secondphotographing mode. A frame 1901 indicates a view angle which changes inaccordance with the magnification ratio of optical zoom. The imagesensing element 102 and memory 1 (202) process image sensing data havingan image size corresponding to the frame 1601. The image sensing signalprocessing circuit 203 extracts an image size corresponding to a frame1603 from image data held in the memory 1 (202) and executes signalprocessing. A variable magnification processing circuit 204 outputs theimage data output from the image sensing signal processing circuit 203without executing electronic variable magnification processing. Withthis arrangement, in the second photographing mode, the digital videocamera executes the zoom operation by using only optical zoom. Thedigital video camera obtains image data corresponding to a recordingimage 1602 in the maximum wide-angle state or a recording image 1606 inthe maximum telephoto state. A recording image 1604 is an image duringzooming.

In the above-described second photographing mode, the view angle isdifferent from that in optical zoom with reduction processing describedin the first embodiment. However, image recording without any change inimage quality due to reduction can be implemented. When the samplingmatrix of the image sensing element 102 is different from that of therecording format, as described above, processing at a magnificationratio of ×1 is executed in one of the horizontal and verticaldirections. For the other direction, electronic variable magnificationprocessing is executed. Even in this case, since no variablemagnification processing is executed in the direction of magnificationratio of ×1, image recording without any degradation in image quality inthe direction of magnification ratio of ×1 can be implemented.

As the third embodiment of the present invention, a digital video camerawhich executes a zoom operation without using an optical zoom means willbe described next.

FIG. 20 is a block diagram showing the schematic arrangement of adigital video camera according to the third embodiment of the presentinvention. The same reference numerals as in the digital video camerashown in FIG. 1 denote constituent components having the same functionsin the digital video camera shown in FIG. 20, and a description thereofwill be omitted. The digital video camera shown in FIG. 20 is differentfrom that shown in FIG. 1 in a lens optical system 101 a, camera signalprocessing circuit 104 b, maximum magnification ratio setting circuit109 a, and maximum magnification ratio selection switch 111 a. Thedifferent parts will mainly be described.

The lens optical system 101 a includes an optical lens which forms animage of incident light on an image sensing element 102, an aperture, afocus controller, various kinds of optical filters, and a drivingmechanism for them. The above-described optical mechanism in the lensoptical system 101 a of the digital video camera shown in FIG. 20 is acommon mechanism, and a detailed description thereof will be omitted. Inaddition, the lens optical system 101 a has no zoom function, unlike thelens optical system 101 shown in FIG. 1.

The camera signal processing circuit 104 b executes various processingoperations for converting image sensing data supplied from an A/Dcircuit 103 into image data. The processing executed by the camerasignal processing circuit 104 b will be described later in detail. Themaximum magnification ratio setting circuit 109 a sets the maximummagnification ratio in the zoom operation in accordance with setting ofthe maximum magnification ratio selection switch 111 a. The setting bythe maximum magnification ratio setting circuit 109 a will be describedlater in detail. The digital video camera shown in FIG. 20 comprises notonly the constituent components shown in FIG. 20 but also constituentcomponents prepared in common digital video cameras, including a systemcontroller, a recording medium driving circuit, and a user interfacecircuit. However, these constituent components are unnecessary for thedescription of the embodiment of the present invention and therefore arenot illustrated.

The camera signal processing circuit 104 b shown in FIG. 20 will bedescribed next in detail. FIG. 21 is a block diagram for explainingdetails of the camera signal processing circuit 104 b shown in FIG. 20.The same reference numerals as in the camera signal processing circuit104 shown in FIG. 2 denote constituent components having the samefunctions in the camera signal processing circuit 104 b shown in FIG.21, and a description thereof will be omitted. The camera signalprocessing circuit 104 b shown in FIG. 21 has an electrical zoom controlcircuit 1811, unlike the camera signal processing circuit 104 shown inFIG. 2. This different part will mainly be described.

The electrical zoom control circuit 1811 decides the zoom magnificationratio in accordance with a zoom operation key input for a terminal 214and controls the image extraction area size from a variablemagnification processing circuit 204 and memory 1 (202). In the variablemagnification processing circuit 204, an electrical zoom operationcorresponding to the zoom magnification ratio decided by the electricalzoom control circuit 1811 is executed. The maximum magnification ratioselection value input to the terminal 214 is processed by the electricalzoom control circuit 1811. The electrical zoom control circuit 1811outputs zoom magnification ratio indication data to a zoom magnificationratio indication circuit 110 shown in FIG. 20 through a terminal 215.Recording mode data which designates a first recording mode (still imagerecording mode) or a second recording mode (moving image mode) is inputfrom a recording mode control circuit 108 shown in FIG. 1 to theelectrical zoom control circuit 1811 through a terminal 210. Thisrecording mode data is also input to an image sensing signal processingcircuit 203, as described above.

The operation of zoom processing in the digital video camera accordingto the third embodiment will be described here.

FIG. 22 is a view showing the outline of the zoom processing operationin the digital video camera shown in FIG. 20. A frame 1901 indicates aview angle when electrical zoom is in the maximum wide-angle state. Theimage sensing element 102 and memory 1 (202) process image sensing datahaving an image size corresponding to the frame 1901. In thisembodiment, in the second recording mode, the image sensing data havingthe image size corresponding to the frame 1901 is reduced and recorded.Reference numeral 1902 denotes a reduced recording image and its imagesize, which is obtained by reducing the image sensing data having theimage size corresponding to the frame 1901 to an image sizecorresponding to the DV format while keeping the view angle unchangedand recorded in a recording medium 106.

A frame 1903 indicates an extraction area at a magnification ratio of×1, i.e., a partial image area having an image size equal to therecording image size in the image sensing data with the image sizecorresponding to the frame 1901. When the image sensing data is to beextracted in correspondence with the frame 1903 and subjected to signalprocessing, electronic variable magnification ratio=1 (×1) because theextraction size equals the recording size. When the sampling matrix ofthe image sensing element 102 is different from that of the recordingformat, processing at a magnification ratio of ×1 is executed in one ofthe horizontal and vertical directions. For the other direction,electronic variable magnification processing is necessary. A recordingimage 1904 is obtained by processing an image area corresponding to theframe 1903.

A frame 1905 indicates an extraction image area in the maximum telephotostate, i.e., a partial image area necessary for electrical zoomprocessing at the maximum variable magnification ratio in the imagesensing data with the image size corresponding to the frame 1901. Arecording image 1906 is obtained by processing an image areacorresponding to the frame 1905.

A change in extraction image area from the above-described frame 1901 tothe frame 1903 is implemented by electrical zoom processing (reductionprocessing) by the camera signal processing circuit 104 b. Theextraction image area change region is an electrical zoom 1 region 1907shown in FIG. 22. A change in extraction image area from theabove-described frame 1903 to the frame 1905 is implemented byelectrical zoom processing (enlargement processing) by the camera signalprocessing circuit 104 b. This extraction image area change region is anelectrical zoom 2 region 1908 shown in FIG. 22.

More specifically, as indicated by the electrical zoom 1 region 1907,the electrical zoom effect is obtained by changing the extraction imagesize in accordance with electronic variable magnification (reduction)processing for a predetermined recording image size. When the extractionimage size changes from the frame 1903 to the frame 1905, extractionimage size<recording image size. In this case, enlargement processing isexecuted at an electronic variable magnification ratio>1. Morespecifically, from the frame 1903 corresponding to extraction at amagnification ratio of ×1 to the frame 1905 corresponding to the upperlimit (maximum magnification ratio) of electrical zoom, the electricalzoom effect is obtained by changing the extraction image size inaccordance with electronic variable magnification (enlargement)processing for a predetermined recording image size.

Processing of a maximum magnification ratio selection value which isinput from the maximum magnification ratio setting circuit 109 a shownin FIG. 20 to the terminal 214 shown in FIG. 21 will be described next.The electrical zoom control circuit 1811 changes the control method ofthe variable magnification processing circuit 204 in correspondence withthe maximum magnification ratio selection value input to the terminal214, thereby changing the zoom control range by zoom operation keyinput. A setting example of the maximum magnification ratio selectionvalue will be described here by using a detailed example of the maximummagnification ratio selection switch 111 a. FIG. 25 is a view showing adetailed example of the maximum magnification ratio selection switch 111a. As shown in FIG. 25, the maximum magnification ratio selection switch111 a is a maximum magnification ratio setting menu by, e.g., a GUIdisplayed on a viewfinder 114 of the digital video camera. This can beimplemented by mounting, in the digital video camera, a program whichimplements the above-described GUI and a CPU which executes the program.

Referring to FIG. 25, a setting menu item display 2201 contains settingmenu items such as “camera shake correction”, “electrical zoom”, and“white balance”. An electrical zoom setting item 2202 is a list ofsetting items related to the electrical zoom function (in this example,the maximum variable magnification ratio), including two items “×2” and“×8”. The electrical zoom setting item 2202 is displayed by selecting“electrical zoom” in the setting menu item display 2201. Referring toFIG. 25, “electrical zoom” in the setting menu item display 2201 isselected, as indicated by an arrow 2203. Referring to FIG. 25, “×8” inthe electrical zoom setting item 2202 is selected, as indicated by anarrow 2204.

The operator of the digital video camera selects the “electrical zoom”menu, i.e., the maximum magnification ratio selection item, from thesetting menu item display 2201 by moving the arrow 2203. With thisoperation, the electrical zoom setting item 2202 is displayed.

When the item “×2” in the electrical zoom setting item 2202 is selected,the electrical zoom 1 region (reduction mode region) 1907 in FIG. 22 isused. In this case, photographing can be executed from the recordingimage 1902 to the recording image 1904. When the item “×8” is selected,the electrical zoom 1 region (reduction mode region) 1907 and electricalzoom 2 region (enlargement mode region) 1908 in FIG. 22 are used. Inthis case, photographing can be executed from the recording image 1902to the recording image 1906.

As described above, by setting the maximum magnification ratio selectionswitch 111 a, the zoom magnification ratio “×2” until electronicvariable magnification is executed as the reduction operation under thecontrol of the electrical zoom control circuit 1811 can be selected asthe maximum variable magnification ratio. Accordingly, the operator canselect a zoom mode in which electronic enlargement processing causes nodegradation in image quality. In addition, under the control of theelectrical zoom control circuit 1811, the extraction image size of imagesensing data held in the memory 1 (202) is changed, and the electricalzoom operation for enlargement/reduction corresponding to the variablemagnification ratio is executed by the variable magnification processingcircuit 204. Extraction control from the memory 1 (202) and variablemagnification processing by the variable magnification processingcircuit 204 are the same as in the first embodiment, and a descriptionthereof will be omitted.

An operation for causing the electrical zoom control circuit 1811 shownin FIG. 21 to supply a zoom magnification ratio indication outputcorresponding to the zoom operation key input to the zoom magnificationratio indication circuit 110 shown in FIG. 20 and causing the viewfinder114 to display the zoom magnification ratio, and display examples willbe described next. FIGS. 23A and 23B are views showing examples of zoommagnification ratio indication on the viewfinder 114 in which aphotographing image is confirmed. FIG. 23A shows a display example ofthe zoom magnification ratio indicator when the maximum variablemagnification ratio is the maximum value of electronic variablemagnification, and zooming can be executed from the electrical zoom 1region 1907 to the electrical zoom 2 region 1908 shown in FIG. 22. Atthis time, setting by the maximum magnification ratio selection switch111 corresponds to “×8” in the electrical zoom setting item 2202 shownin FIG. 25. Referring to FIG. 23A, a zoom magnification ratio indicator2000 includes an indicator 2001 which indicates the zoom magnificationratio during photographing by the digital video camera in a scale havingthe maximum wide-angle state and the maximum telephoto state at twoends. A boundary line 2002 indicates the upper limit of electrical zoom1 (the boundary between the electrical zoom 1 region 1907 and theelectrical zoom 2 region 1908 in FIG. 22). The maximum telephoto staterepresented by “T” corresponds to the recording image 1906 in FIG. 22when the maximum magnification ratio is “×8”.

FIG. 23B shows a display example of the zoom magnification ratioindicator 2000 when zooming can be executed in the electrical zoom 1region 1907 shown in FIG. 22. At this time, setting by the maximummagnification ratio selection switch 111 a corresponds to “×2” in theelectrical zoom setting item 2202 shown in FIG. 25. The maximumtelephoto state represented by “T” corresponds to the recording image1904 in FIG. 22 when the maximum magnification ratio is “×2”.

Examples of the zoom magnification ratio indicator 2000 different fromFIGS. 23A and 23B will be described next. FIGS. 24A and 24B are viewsshowing examples of the zoom magnification ratio indicator 2000different from FIGS. 23A and 23B. The zoom magnification ratio indicator2000 shown in FIGS. 23A and 23B can be scaled (i.e., the zoommagnification ratio indicator 2000 has a predetermined length). However,FIGS. 24A and 24B show display examples in which the scale of the zoommagnification ratio indicator 2000 is fixed (i.e., the length of thezoom magnification ratio indicator 2000 changes).

FIG. 24A shows a display example of the zoom magnification ratioindicator 2000 when zooming can be executed in the electrical zoom 1region 1907 and electrical zoom 2 region 1908 shown in FIG. 22.Referring to FIG. 24A, an indicator 2101 indicates the current zoommagnification ratio. A boundary line 2102 indicates the upper limit ofelectrical zoom 1 (the boundary between the electrical zoom 1 region1907 and the electrical zoom 2 region 1908 in FIG. 22). As describedabove, FIG. 24A corresponds to FIG. 23A described above, and the displayform and display contents are the same.

FIG. 24B shows a display example of the zoom magnification ratioindicator 2000 when zooming can be executed in the electrical zoom 1region 1907 shown in FIG. 22. The zoom magnification ratio indicator2000 shown in FIG. 24B is shorter than that in FIG. 24A (even that inFIG. 23B) by a length corresponding to the electrical zoom 2 region1908. The maximum telephoto state represented by “T” corresponds to therecording image 1904 in FIG. 22 when the maximum magnification ratio is“×2”.

The image sensing element 102 is an area sensor which executes colorimage sensing and in which pixels having a plurality to types of colorfilters are two-dimensionally arrayed. The image sensing element 102also has a plurality of types of driving modes which change inaccordance with, e.g., the recording mode. More specifically, the imagesensing element 102 has a non-cumulative read driving mode in whichstill image data is photographed, and pixel data of all pixels are readout and a cumulative read driving mode in which moving image data isphotographed, and pixel data in the vertical direction are mixed andread out, as described above. The present invention is not limited tothe driving modes of the above-described types. The image sensingelement may have any other driving modes.

Various control circuits in the digital video camera shown in FIGS. 1and 2 may be implemented by dedicated hardware. Alternatively, some orall of the control circuits may be constituted by a memory and CPU(Central Processing Unit), and their processing may be implemented byloading a program to implement various kinds of processing in thecontrol units in the memory and executing the program.

The memory is constituted by a nonvolatile memory such as a hard diskdevice, magnetooptical disk device, or flash memory, a recording mediumsuch as a CD-ROM which can only be read-accessed, a volatile memory suchas a RAM (Random Access Memory), or a computer-readable or writablerecording medium as a combination thereof.

The functions of various control circuits of the above-describedembodiments are also implemented when an operating system (OS) runningon a computer performs part or all of actual processing on the basis ofinstructions of a program read out by the computer.

The functions of various control circuits of the above-describedembodiments may also be implemented when program codes read out from astorage medium are written in the memory of a function expansion boardinserted into the computer or a function expansion unit connected to thecomputer, and the CPU of the function expansion board or functionexpansion unit performs part or all of actual processing on the basis ofthe instructions of the program codes.

The embodiments of the present invention have been described above indetail with reference to the accompanying drawings. Detailedarrangements are not limited to the above embodiments, and designswithout departing from the spirit and scope of the present invention arealso incorporated.

As has been described above, in the signal processing apparatusaccording to the present invention, when the first mode is selected, andthe first detection means detects that the telephoto side iscontinuously selected, first signal processing is executed. When thesecond detection means detects that the increase in magnification ratioof the image by the first signal processing has reached the limit,second signal processing is subsequently executed to enlarge an image.When the second mode is selected, even when the second detection meansdetects that the increase in magnification ratio of the image by thefirst signal processing has reached the limit, and the first detectionmeans then detects that the telephoto side is continuously selected, thesecond signal processing is inhibited. The user can adjust the zoomratio of the image by selecting the mode. The user can therefore selecta zoom mode with a small degradation in image quality in electrical zoomprocessing.

In the image data generation apparatus according to the presentinvention, a maximum variable magnification ratio candidate selected bythe user from a plurality of types of maximum variable magnificationratio candidates is set as the maximum variable magnification ratio. Inaddition, the variable magnification ratio change indication meansindicates, as a boundary line, the value of a maximum variablemagnification ratio candidate whose variable magnification ratio islower than that of the maximum variable magnification ratio. Hence, theuser can select a desired maximum image zoom ratio. That is, the usercan select a zoom mode with a small degradation in image quality inelectrical zoom processing. Furthermore, since the value of the maximumvariable magnification ratio candidate is indicated as the boundaryline, the user can easily grasp the state or influence of electricalzoom processing, and therefore, user can more appropriately select azoom mode with a small degradation in image quality in electrical zoomprocessing.

As many apparently widely different embodiments of the present inventioncan be made without departing from the spirit and scope thereof, it isto be understood that the invention is not limited to the specificembodiments thereof except as defined in the appended claims.

1. A signal processing apparatus which changes a magnification ratio ofan image acquired by an image sensor, comprising: a signal processingunit mounted in the signal processing apparatus to execute a firstsignal processing for magnifying without pixel interpolation, whereinthe signal processing unit executes a second signal processing formagnifying with pixel interpolation; and a display control unit mountedin the signal processing apparatus to display a magnification ratioindicator indicating a magnification ratio on a scale such that theindicator moves on the scale in accordance with changes in amagnification ratio of an image, wherein in a first mode, the firstsignal processing and the second signal processing are executed, and ina second mode, the second signal processing is not executed, and whereinsaid display control unit does not change a length of the scaleregardless of whether the first mode or the second mode is selected, andfurther displays on the scale a magnification range in which the secondsignal processing is applied if the first mode is selected.
 2. Thesignal processing apparatus according to claim 1, wherein said signalprocessing unit further comprises spatial low pass filter to limit aspatial frequency band of the image.
 3. The signal processing apparatusaccording to claim 2, wherein said spatial low pass filter changes afrequency characteristic of the spatial frequency band limit inaccordance with a variable magnification ratio.
 4. The signal processingapparatus according to claim 1, wherein said signal processing unitfurther comprises an edge enhancement unit that enhances an edge ofan-image.
 5. The signal processing apparatus according to claim 4,wherein said edge enhancement unit changes degree of enhancement of theedge in accordance with a variable magnification ratio of said signalprocessing unit.
 6. The signal processing apparatus according to claim5, wherein in the first mode and the second mode, when the variablemagnification ratio of the image acquired by the image sensor is x1, thefirst signal processing and the second signal processing are notexecuted.
 7. The signal processing apparatus according to claim 1,wherein the signal of the image is enlarged by the second signalprocessing.
 8. A signal storage apparatus comprising a signal storageunit that stores a signal of an image, wherein the signal of the imageprocessed by a signal processing apparatus of claim 1 is stored in saidsignal storage unit.
 9. An image recording apparatus comprising: thesignal processing apparatus according to claim 1; and an opticalvariable magnification unit that changes a view angle of an object imageformed on a light receiving surface of the image sensor, whereinvariable magnification by said optical variable magnification unit isexecuted in the first signal processing.
 10. The signal processingapparatus according to claim 1, in case where the first mode isselected, the second signal processing is performed when the seconddetection unit detects that the magnification ratio in the first signalprocessing has reached the limit.